gradient descent
Related Words
optimizationalgorithmcalculusderivativegradientcost functionloss functionlearning rateconvergenceminimumlocal minimumglobal minimumsaddle pointbackpropagationneural networkmachine learningdeep learningstochastic gradient descentmomentumoptimizerparameterweightbiasiterationepochconvexitypartial derivativevectorscalarmanifoldslopecurvatureHessianJacobianoverfittingunderfittingregularizationobjective functionhyperparametertraininginferenceregressionclassificationlinear regressionlogistic regressionactivation functionsigmoidtanhdivergenceplateaulandscapestochasticitynoisedecayannealing